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1. Introduction 

It has recently been shown 1 , by application of statistical mechanical methods to de- 
termine the canonical ensemble governing the equilibrium distribution of operator initial 
values, that complex quantum field theory can emerge as a statistical approximation to 
an underlying generalized quantum dynamics. 2 ' 3 This result was obtained by an argument 
based on a Ward identity analogous to the equipartition theorem of classical statistical 
mechanics. 1 In the following, we describe some features of generalized quantum dynamics 
and the motivation for its development. We then describe how the equilibrium ensem- 
bles are constructed, and briefly review the emergence of the usual complex quantum field 
theory in the ensemble average. 

The field variables associated with a hypercomplex quantum theory, such as quater- 
nionic quantum mechanics, form an essentially non-commutative set of functions, even 
when they are not second-quantized. The construction of a dynamical theory then requires 
a generalized structure, which is the main subject of our discussion here. To understand 
why this is so, consider the Heisenberg picture of a scalar field. 3 The generator of evolu- 
tion in time is taken as an anti-self-adjoint operator, since there is, in general, no natural 
complex unit to extract a self-adjoint operator from the representation of a one-parameter 
unitary group. The Heisenberg picture for a quaternionic field of the form 

3 

<f>(x) = ^2 <pAeA, (1.1) 

A=0 

where eo = 1 and e\, e2, e 3 are the quaternionic units satisfying the cyclic relations 

eie 2 = e 3 , e\ = -1 A = 1,2, 3, (1.2) 

is given by 

(j) H (x,t) = e Ht (p(x)e~ Ht 

* (1.3) 

= 4>o(x, t) + 4>ah(x, t)e A {t), 

A=l 

where the {4>ah (x, t)} are kinematically independent, i.e., the commutation relations are 
the same as the Schrodinger picture fields. However, if we expand over the original set of 
quaternionic units {e^} on the components defined by 

3 

4> H (x,t) = ^ (f>H{x,t) A e A , (1.4) 
A=o 

then the {(()h(x, t) A } are not kinematically independent. As an illustrative example, con- 
sider the simple case in which H is some real valued operator multiplied by e\. Since 

em(t) = ei 

e2H (t) = e m e 2 e- m = e 2kt e 2 (1.5) 
es H (t) = e kt e 3 e~ kt = e 2kt e 3 , 
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the coefficients of the constant {e^} are 



0hOM)i = (t>m(x,t) 

(pH(x,t) 2 = (P 2 H(x,t)e 2flt (1.6) 
<MM)a = (p 3 H(x,t)e 2Ht . 

Due to the presence of the additional factor containing H, the commutation relations are 
not the same as those of the Schrodinger fields, and, in fact, 

[MM)a,Ms',*)b]^0. (1.7) 

The same result is true for gauge fields of the form = ^B^a^-a- A similar structure 
was found in the studies of ref. 4, a program concerned with the static limit of generalized 
non-Abelian gauge theories. In order to construct a c-number action for theories of this 
type, the notion of a total trace was introduced 2 ' 3 , where both the quantum state and 
algebraic representation indices are summed over in the trace. As we shall see in the next 
section, one can define a total trace Lagrangian and Hamiltonian over an underlying phase 
space of quantum fields which results in a symplectic dynamics with many of the properties 
of classical mechanics. We shall the describe the flows induced by an important class of 
conserved operators, and show how a statistical mechanics can be constructed on the phase 
space of the underlying quantum fields. 



2. Generalized quantum dynamics 

Generalized quantum dynamics 2 ' 3 is an analytic mechanics on a symplectic set of 
operator valued variables, forming an operator valued phase space S. These variables are 
defined as the set of linear transformations ^ on an underlying real, complex, or quaternionic 
Hilbert space (Hilbert module), for which the postulates of a real, complex, or quaternionic 
quantum mechanics are satisfied 3 ' 5-8 . The dynamical (generalized Heisenberg) evolution, 
or flow, of this phase space is generated by the total trace Hamiltonian H = TrH, where 

TrO = ReTr(-l) F 

= Re^H(-l) F 0|n>, ( 2J ) 

n 

H is a function of the operators {q r (t)}, {p r (t)}, r = 1,2, ...,N (realized as a sum of 
monomials, or a limit of a sequence of such sums; in the general case of local noncommuting 
fields, the index r contains continuous variables), and (— 1) F is a grading operator with 
eigenvalue 1(— 1) for states in the boson (fermion) sector of the Hilbert space. Operators 
are called bosonic or fermionic in type if they commute or anticommute, respectively, with 
(— 1) F ; for each r, p r and q r are of the same type. 

The derivative of a total trace functional with respect to some operator variation is 
defined with the help of the cyclic property of the Tr operation. The variation of any 

t In general, local (noncommuting) quantum fields. 
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monomial O consists of terms of the form Oi,Sx r Oji, for x r one of the {q r }, {p r }, which, 
under the TV operation, can be brought to the form 



SO = oTVO = ±TrO R L 8x r , 
so that sums and limits of sums of such monomials permit the construction of 

SO = TrJ2jr-$Xr, (2.2) 

r 

uniquely defining SO/Sx r . 

Assuming the existence of a total trace Lagrangian 2 ' 3 L = L({g r }, {q r }), the variation 
of the total trace action 

/oo 
L({q r },{Qr})dt (2.3) 
-oo 

results in the operator Euler-Lagrange equations 

Sq r dt Sq r 

As in classical mechanics, the total trace Hamiltonian is defined as a Legendre transform, 

H = TV ^ p r q r — L, (2.5) 

r 

where 

Pr=T~- (2-6 

Sq r 



It then follows from (2.4) that 



su .su. , nrr . 

Y~ = -Pr Y~ = e rQr, (2.7) 

Sq r Sp r 



where e r = 1(— 1) according to whether p r ,q r are of bosonic (fermionic) type. 
Defining the generalized Poisson bracket 

{A, B} = TV^ £r (__-__), (2.8a) 



r 



one sees that 



Conversely, if we define 



£ = £ + { A,H>. (2.86) 



x a (77) = Tr( V x s ), (2.9a) 
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for r] an arbitrary, constant operator (of the same type as x s , which denotes here q s or p s ), 
then 

= Tr V, ( - ™ 6 *W) , ( 2 .96) 
at \ oq r op r oq r op r J 

and comparing the coefficients of rj on both sides, one obtains the Hamilton equations (2.7) 
as a consequence of the Poisson bracket relation (2.86). 

The Jacobi identity is satisfied by the Poisson bracket of (2.8a), 9 and hence the total 
trace functionals have many of the properties of the corresponding quantities in classical 
mechanics. 10 In particular, canonical transformations take the form 

5x s (r ? ) = {x s (? ? ),G}, (2.10a) 

which implies that 

5p r = -— , 5q r = e r — , (2.106) 
oq r op r 

with the generator G any total trace functional constructed from the operator phase space 
variables. Time evolution then corresponds to the special case G = licit. 

3. Flows and algebras associated with conserved operators 

The operator 

C = ^2(e r q r p r -p r q r ) 

r,B r,F 

where the sums are over bosonic and fermionic pairs, respectively, is conserved under the 
evolution (2.7) induced by the total trace Hamiltonian. When the equations of motion 
induced by the Lagrangian L coincide with those induced by the ungraded total trace of 
the same Lagrangian (there are many models which have this property 1 ), 

L = ReTrL, 

without the factor (— 1) F , the corresponding ungraded total trace Hamiltonian H is con- 
served; it may therefore be included as a constraint functional in the canonical ensemble, 
along with the new conserved operator 

C = ^2[q r ,Pr] 

(3.2) 

r,B r,F 

We now study the action of general total trace functionals projected from C and C as 
generators of canonical transformations on the phase space. We first remark that it was 
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pointed out in ref. 1 that a canonical generator of unitary transformations on the basis of 
the underlying Hilbert space has the form 

G~ f = -TrJ2[f,Pr]q r , (3.3) 

r 

where / is bosonic. Using (3.1) and the cyclic properties of TV, one sees that 

Gf = -Tr f^2(p r q r - e r q r p r ) 

(3.4) 

= Tr fC. 

We thus see that the conserved operator C has the additional role of inducing the action 
of unitary transformations on the underlying Hilbert space. 

That this action preserves the algebraic properties of functionals of the type G i can 
be seen by computing the Poisson bracket 

We use the result that 



6Gj = TrfdC 

= Tr^{e r (/g r - q r f)5p r ~ (fp r -Prf)Sq r } 



(3.6) 



to obtain 

5G f 

1 T L = -[f,Pr}, 
5q r 

SG f 

= £r[f, q r ], 

OPr 

and hence, expanding out the commutators, one finds that 



(3.7) 



{Gf, Gg} = -Tr^2[f,g](p r q r -e r q r p r ) 

r 

= Tr[f,g\C 

= G [f,~ 9 y 



(3.8) 



These relations, corresponding to the group properties of integrated charges in quantum 
field theory, can be generalized to a "local" algebra. Defining 

G /r = TV/CV, (3.9) 

where 

C r = e r q r p r — p r q r , (3.10) 
6 



one obtains in the same way that 



{Gj r , Gg S } — S rs G^^ r . (3.11) 

In studying the flows induced by conserved operators, we shall also need the properties 
of generators projected from C. We therefore define 

Gj = Trfd. (3.12) 

Substituting (3.2), we find that the operator derivatives of Gf with respect to the phase 
space variables are 

-£-Gf = -(-l) F [(-l) F /, Pr ] = -(fPr ~ €rPrf), 

t (3.13) 



-G f = (-l) F [(-l) F f, qr ] = fq r - e r q r f. 



Computing Poisson brackets in the same way as above, we find that the algebra of the 
generators Gf and Gf closes, 

{Gf, Gg} =Grf -1, 

. . (3.14) 

{Gf, Gg} ={Gf, Gg} = Gy- -], 

giving a structure analogous to that of the vector and axial-vector charge algebra in quan- 
tum field theory. The algebra of (3.8) and (3.14) can be diagonalized into two independent 
algebras 

G ± f=±(G f ±Gf), (3.15) 

which obey the algebra 

{G ± f,G ± g}=G ±[fVg] , 
{G.f.G ,} 0. 

Defining a "local" version of Gj by 

G fr = Tr/CV, (3.17) 

where 

C r = q r p r — p r q r , (3.18) 

the algebras of (3.14) and (3.16) can be converted to local versions analogous to (3.11). 

We now turn to the flows associated with G f and G f when used as canonical genera- 
tors. Beginning with Gf, we consider its action on the functional x s (??) defined in (2.9a), 
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for which 5x. s (r}) = Trr]Sx s . Defining a parameter 7 along the motion generated by Gj, 
we choose 8x s as dxg/d'y, so that by (2.10a) we have 

dx s (r ] ) = {x a (r ] ),G f ~}d 1 . (3.19) 

Comparing (2.106) with (3.5) and (3.19) gives 

dq s r y , 

*- u i (3 ' 20) 

In both the boson and fermion sectors we see that, as a solution of the differential equations 
(3.20), Gj induces the action of a unitary group generated by /, 

Xfl ( 7 ) = e / " 7 x s (0)e _/ " 7 . (3.21) 

The transformation (3.21) is unitary and norm preserving. 

We next consider the canonical transformation induced on x s (?y) by the functional Gj 

defined in (3.12). Introducing a parameter 7 along the motion generated by Gf, we have 
in this case by (2.10a), 

dx s (r 7 ) = {x s (r 7 ),G / }d7. (3.22) 
Comparing (2.106) with (3.13) and (3.22) gives 



= e s (-l) F [(-l) F /,o s ] = e s fq s -q s f, 
^f = (-l) F [(-l) F f,Ps] = fPs-e sPs f. 



(3.23) 



For the bosonic sector, (3.23) can be rewritten as 

dq s r r 1 
^ =[/,*], 

^-=[/,P.], 



(3.24) 



and can be integrated as a unitary transformation for both q s and p s , 

x a (<y) = e^x a (0)e-^. (3.25) 

For the fermionic sector, however, the grading index (— 1) F anticommutes with q s and 
p s and e s = — 1; consequently, the differential equations (3.23) in this case take the form 



and involve anticommutators with the operator /, i.e., a graded action. We note, however, 

that the total trace Lagrangians for which C is conserved are ones in which the fermion 
fields appear as bosonic bilinears of the form p r q s ; for these bilinears, and for the reverse 
ordered bosonic bilinears q s p r , we find from (3.26) that 



d(q s p r ) r ? i 
—^ = -[f,q s Pr). 

The solution of these differential equations is the unitary group action 

(Prqs)(l) = e f ~Hp r q s )(0)e-K, 
(qsPr)(l) = e- f 'Hq s p r )(0)e^, 



(3.27) 



(3.28) 



which preserves the supremum operator norm of the bilinears p r q s and q s p r . However, it is 
easy to see that for fermionic operators, the supremum operator norm of is not preserved 
by the evolution of (3.26). 

Finally, it is also useful to define parameters 7 ± along the flows generated by G ± j 
according to 

dx s ( V ) = {x s (77), G ±/ }d 7± , (3.29) 

so that 

dx s _ 1 / dx s dx s \ 

Then taking sums and differences of (3.20) and (3.24), (3.26) we find that for bosons (with 
x s either q s or p s ), 



dx s r . 

=[f,Xs\, 

dx s 
d"f- 

which integrate to 

£ s ( 7+ ) =e fry x s (0)e~ fl , 
x s ( 7 _) =x s (0). 
Similarly, for fermions we find that 

dq s 7 dp s ~ 

~j =-Qaf , -j = f Pa, 

dq s 7 dp s ~ 

-j — =/ Qs , ~, — = -Psf, 
a 7 _ a 7 _ 

which integrate to 

q s ( 1+ ) =q a (0)e-^+ , p s ( 7 +) = e^+p a (0), 

g fl ( 7 _) =e^-q s (0) , p s ( 7 _) = p a (0)e"^- 
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(3.31) 



(3.32) 



(3.33) 



(3.34) 



This identifies G ± ? as the generators of the one-sided unitary transformations acting on 
the fermions which are discussed in refs. 2 and 3. 

4. The microcanonical and canonical ensembles. 

Introducing a complete set of states {\n)} in the underlying Hilbert space, the phase 
space operators are completely characterized by their matrix elements (m\x r \n) = (x r ) mn , 
which have the form 

( x r)mn = ^ ' (^ImB^' (4-1) 
A 

where A takes the values 0, 1 for complex Hilbert space, 0, 1, 2, 3 for quaternion Hilbert 
space (technically, a Hilbert module), and just the one value for real Hilbert space, and 
the eA are the associated hypercomplex units (unity, complex, or quaternionic units 2 ). We 
restrict ourselves here to these three cases. The phase space measure is then defined as 

d/j= Yl d(x r )i n , (4.2) 

r,m,n,A 

where redundant factors are omitted according to adjointness conditions. The measure 
defined in this way is invariant under canonical transformations induced by the generalized 
Poisson bracket. 1 

We then define the microcanonical ensemble in terms of the set of states in the un- 
derlying Hilbert space which satisfy 5-function constraints on the values of the two total 
trace functionals H , H and the matrix elements of the two conserved operator quantities 

C , C discussed in Section 1. The volume of the corresponding submanifold in phase 
space is given by [see ref. 11 for a somewhat more detailed discussion] 

F(E, E,i>,i>) = J d^td(E -H)S(E -H) 

II ^-{n\{-l) F C\m) A )5{^ m -{n\t\m)% 

n<m,A 

where we have used the abbreviations v = {v^m} an d v = {^nm} f° r the parameters in 
the arguments on the left hand side. The factor (— 1) F in the term with C is not essential, 
but convenient in obtaining the precise form given in ref. 1 for the canonical distribution. 
The entropy associated with this ensemble is given by 

S mic (E, E, v, v) = log F(E, E, t>, £). (4.4) 

The operators C and C are defined in terms of sums over degrees of freedom. In 
the context of the application to quantum field theory, the enumeration of degrees of 
freedom includes continuous parameters, corresponding to the measure space of the fields. 
These operators may therefore be decomposed into parts within a certain (large) region 
of the measure space, which we denote as 6, corresponding to what we shall consider as a 
bath, in the sense of statistical mechanics, and within another (small) part of the measure 
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space, which we denote as s, corresponding to what we shall consider as a subsystem. We 
shall assume that the functionals H and H may also be decomposed additively into parts 
associated with b and s; this assumption is equivalent to the presence of interactions in the 
Hamiltonian or Lagrangian operators which are reasonably localized in the measure space 
of the fields (the difference in structure between the Lagrangian and Hamiltonian consists 
of operators that are explicitly additive), so that the errors in assuming additivity are of 
the nature of "surface terms". The constraint parameters may then be considered to be 
approximately additive as well, and we may rewrite the microcanonical ensemble as 



T{E, E, i>,v) = J dE s dE s (dv s )(dv s ) T b (E -E S ,E- E s , v-v 8 ^v- P s ) T S (E S , E s , z> s , P s ). 

(4.5) 

We now assume that the integrand in (4.5) has a maximum which dominates the 
integral when there is a large number of degrees of freedom. Let us, for brevity, define (we 
suppress the index s in the following) 

^ = {^} = {E,E,i>,i>}, (4.6) 

where the index i refers to the elements of the set of variables, so that (4.5) takes the form 

r(s) = J der 6 (s-or.(0, (4-7) 

where S corresponds to the set of total properties for the whole ensemble. A necessary 
condition for an extremum in all of the variables at £ = £ is then (for every i) 

A[r 6 (S-£)r s (£)]| ? - = 0, (4.8) 

which implies that 

The logarithmic derivatives in (4.9) define a set of quantities analogous to the (reciprocal) 
temperature of the usual statistical mechanics, i.e., equilibrium- fixing Lagrange parameters 
common to the bath and the subsystem. We write these separately as 



d_ 

dE 
d 



A^ = -^iogr s (£)| f 
^ m = -^-iogr s (£)| f . 



(4.10) 
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According to the definition of entropy (4.4), the bath phase space volume is given by 



^(H, exp{ _ E ^n (E)} , 

Neglecting the small shift in argument S — > S — £ s , it follows from (4.7) — (4.10) that 

T b (E - Q = e Sb ^ eM-rE - rE + £ (i^A^ + ^ m A^ m )}. (4.12) 

We now return to (4.5), replacing the phase space volume of the bath, r&, by the 
approximate form (4.12), and the subsystem phase space volume T s by the phase space 
integral over the constraint 5-functions. 

Carrying out the integrals over the parameters, the 5-functions imply the replacement 
of the parameters E, E : u^ m , v^ m in the exponent by the corresponding phase space 

quantities. Using the anti-self-adjoint properties of C and C, and defining the operator A 
for which the matrix elements are (n|A|m) = -|A nm , n ^ m„ and (n|A|n) = A nn , we see 
that the first term in the sum in the exponent in (4.12) is —TrXC. A similar result holds 
for the last term of the sum (in this case, since we did not insert the factor (— 1) F , we 
obtain the Tr functional). The volume in phase space is then 

r(S) = e Sb( - E) J d/j s exp -{rH s + fH s + Tr\C s + Tr\& a }, (4.13) 

so that the normalized canonical distribution function is given by 

p = Z- 1 exp-{rH + fH + TrAC' + TrAC'}, (4.14) 

where 

Z = J dp exp -{rH + fH + TrAC + TrAd}. (4.15) 

This formula coincides with that obtained by Adler and Millard. 1 Note that the opera- 
tors A and A appear as an infinite set of inverse "temperatures", i.e., equilibrium Lagrange 
parameters associated both with the bath and the subsystem, corresponding to the con- 
served matrix elements of (— 1) F C and C. 

If A is a function of A, then the ensemble average of an operator (9, which we denote 
as (0)avi is a function of A (and other scalar parameters), and hence commutes with it. 
If we diagonalize (C)av to the form i e ffD, and assume that D is totally degenerate 1 , and 
equal to h, then the analog of the equipartion (Ward) identities gives 1 

= (h(x r )eff ~ i e ff[H eff , (x r ) e ff}) A Vi 
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where we write the subscript eff to indicate the part of the operator that commutes with 
i e ff- All of the complex canonical structure is then reproduced in the ensemble average. 
A second set of Ward identites 1 implies that for fermionic q r , p r , 

(Heffqr)AV = {PrH e ff}AV = 0; 

from this, one sees that ( )av appears to have properties of the Wightmann vacuum. 

We finally remark that the microcanonical entropy defined in (4.4) provides the Ja- 
cobian of the transformation from the integration over the measure of S in (3.15) to an 
integral over the parameters defining the microcanonical shells. To see this, we rewrite 
(4.15) as 

Z = J d^dEdE(du)(du)S(E - H) S(E - H) 

x II ^L-(n\(-l) F C\m) A )8(^ m -(n\d\m) A ) (4.16) 

n<m, A 

x exp -{tE + fE + TrXD + TrAz/}, 
where we have defined the anti-self-adjoint parametric operators v and v by 

vL = (n\(-l) F *\m}, 
"nm = (n\i>\m) A . 



(4.17) 



The phase space integration over the 5-function factors reproduces the volume of the micro- 
canonical shell associated with these parameters, i.e, the exponential of the microcanonical 
entropy, so that the partition function can be written as 

Z = J ' dEdE(du)(du)e Smi ^ i! ' v ' i>) exp -{tE + tE + TrA£ + TrA£}. (4.18) 

We now turn to study the stability of the canonical ensemble as associated with the 
dominant contribution to the microcanonical phase space volume. To this end, we formally 
define the free energy A as the negative of the logarithm of the partition function, " 

ZEe -A(T,T,A,A) ) ( 419 ) 

so that (4.15) can be written as 

1 = J diie A{r ^ X ~ x) exp -{rH + fH + TrAC + TrXC}. (4.20) 

Let us now define the set of variables 

te} = {r,r,-A^ m ,-A^ m }. (4.21) 



" The conventional symbol for the free energy should not be confused with the hyper- 
complex index A. 
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Differentiating (4.20) with respect to each of these, one finds (as in Eqs. (49) of ref .1) the 
relations 11 

' U 6, (4-22) 



dXi 



where we have associated the average values of the dynamical variables H, H, C„ m and 
Cnm with E, E, v^ m and z>^ m . 
We now consider the identity 

= J d(i(H— (H) A v)e A{T ^ X ~ X) exp -{rH + f H + TrXC + TrXC}. (4.23) 

Differentiating with respect to r, one finds 

= ! dlM (|1 _ H ) (H - (H) AV )e A ^ 

_ o/ H v ( 4 - 24 ) 

x exp -{rH + f H + TrXC + TrXC} - [ J AV ' , 

or 

so that, from (4.22), we find that (as in ref. 1) 

«H-(HW)V=-^ = -^>». (4.25) 

In fact, applying this argument to all of the dynamical quantities (including cross 
terms), one can show that A is a locally convex function. 11 The Taylor series expansion of 
A(£ + 5£), up to second order, is, with the help of the relations obtained in this way, given 
by 

A(t + 5t,t + Sf, X + 5X,X + SX) 
=A(t,t,X,X) + 5t(H.) av + 5t(£l) av - ^ (SX A m (C A m } AV + 5X A m (C A m } AV ) 

n<m,A 

1 . . (4-26) 

--([Sr(H - (H) AV ) + (Jf(H - (H) AV ) 

- ^2 ^^nm(C A m - (C A m ) A v) + SX A m (C A m - {C A m ) A v)] 2 )AV, 
m<n,A 

the uniform negative sign of the quadratic term in the expansion indicates that A is a 
locally convex function, and shows that the matrix of second derivatives of A is negative 
semidefinite. 

We now turn to the alternative expression of (4.18) for the partition function, defined 
in terms of an integral over the parameters of a sequence of microcanonical ensembles. 
The existence of a maximum in the integrand which dominates the integration assures the 
stability of the canonical ensemble; we show that (4.26) implies the self-consistency of our 
assumption of a maximum. 
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The conditions for a maximum of the integrand at £ = £ in (4.18) are that there be a 
stationary point, i.e., that 

X. = ^fl f , (4.27) 
together with the requirement that the second derivative matrix 

9 S m i c d^Ci 



diidij <9£j 

should be positive definite. 

The matrix inverse to the right hand side of (4.28) is given by 

<9£, d 2 A 



(4.28) 



(4.29) 



dXi dxidxj 

which we have shown to be a negative semidefinite matrix. This in turn implies that the 
matrix on the right hand side of (4.28) is negative definite, giving the condition needed to 
assure that the stationary point in (4.27) is indeed a (local) maximum. 

Assuming this maximum dominates the integration, then the logarithm of the integral 
in (4.18) (up to an additive term which is relatively small for a large number of degrees of 
freedom) may be approximated by 

A = rE + tE + TrXC + frXC - S mic (E, E, C, C), (4.30) 

where the arguments are at the extremal values, giving the analog of the standard ther- 
modynamical result A = E — TS for the free energy. 
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